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TITLE OF THE INVENTION 

APPARATUS, METHOD, SIGNAL AND COMPUTER PROGRAM PRODUCT 
CONFIGURED TO PROVIDE OUTPUT IMAGE ADJUSTMENT OF AN IMAGE FILE 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to image files and image file output technology. More 
particularly, the present invention relates to apparatuses, such as digital still cameras (DSC), digital 
video cameras (DVC), scanners, which capture and store images for subsequent visual presentation 
to an end user via an output device, such as a printer or display. Thus, the invention also relates to 
signal processing hardware and software components, including propagated data signals, and 
presentation devices, such as printers. 

Discussion of the Background 

In contrast to a normal camera, for which the typical captured image output format is a 
recording paper, images shot by DSCs or DVCs can be used as an image file. Because these 
image files contain digital data, handling of the image files is easy. Thus, it is possible to output the 
image data in a variety of output formats that can be used for display by a variety of file output 
devices, such as CRTs, LCDs, printers, projectors, and television receivers. 

However, as recognized by the present inventors, each of these output devices has different 
image output characteristics. This, in turn, means that an image file generated by a particular DSC 
will appear different, depending on the selected output device. Even output devices of the same 
class, e.g., DSC, will have different output characteristics, and so there is some variability on print 
result for an image taken by a DSC, depending on the selected output device. For example, when 
an image file is presented for display on a CRT, or on processing standards (such as sRGB color 
space) developed for a CRT, a problem will arise when this image file is output by a printer. The 
problem is one of suboptimal matching of printer image output characteristics for the processing 
performed on the image generated by the DSC. This problem is not unique to DSCs, but is also a 



problem with other image file generating devices such as DVCs as well. 

Despite the fact that image files can have their image quality adjusted (image quality 

adjustment) after shooting, there is the problem that the preferences of the image file user can not be 

reflected in the image output. Some image file modification software or the like may be used to 
5 provide suitable output results at a desired output device or to obtain output results that suit the 

photographer's or editor's own preferences by performing image quality adjustments on image files. 

It would be convenient if suitable output results could be obtained without performing this kind of 

image quality adjustment. A limitation with the generation of image files in this way is that when a 
y photographer prepares to take a photo (create an image), the photographer creates a mental image 

^0 10 and then makes the necessary camera adjustments to take the photo. However, the results as 
H ; printed on a printer or other output device may not be matched with what the photographer actually 

intended to capture. 

'7 For example, the photographer may select a Marco mode to define a sharpness before 

taking a picture of a flower, for example. Alternatively, the user may select a portrait mode to blur 
W 15 the background so as to capture a child's expression more clearly, or increase shutter speed for 
q example. In order for the photographer to produce the images that the photographer intended to, 

r ~ the image data must be transferred from the DSC in a way so that the information is not lost or 

otherwise converted before being output on a desired output device. 

However, when looking at the image capturing and reproduction process from the output 
20 device (e.g., printer's) side, there is no process or mechanism that allows for the data to be 
transferred and processed in a way to ensure that the image data has not been altered, or at a 
minimum uncompromised, before provided to the printer. As a result, printers are inherently limited 
in being able to ensure that images produced by the printer are faithful to the image that the 
photographer was seeking to take. On the other hand, DSCs are inherently limited in their ability to 
25 control downstream processing so as to ensure the image will be faithfully reproduced. 

As recognized by the present inventors, without being able to optimally match a DSC (or 
other imaging device) with a printer (or other output device for presenting images from image files), 
there is no guarantee that the printer will faithfully produce an output image, consistent with the 
image sought by the photographer. 
30 This variability in operation characteristics between imaging devices and output devices 
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gives rise to a marketing difficulty for imaging device vendors, as well as output device vendors. In 
a commercial sales setting, samples of the various DSCs offered for sale are made available to the 
consumers, although there is usually only one printer available for printing the results. In this 
situation, there is a general lack of consistency in a how a printed output from a particular DSC will 
5 be viewed, since different printers with different characteristics will be used for printing the image. 
Therefore, one particular DSC may give a potential consumer one impression when viewed in the 
store and a different impression when used on the consumer's home computer. This lack of 
consistency and uniformity in the commercial market, makes it difficult for particular DSC 
p p manufacturers, particularly ones that do not have a large market share to be able to participate on 

/fc: 10 an equal footing with other DSC manufacturers, who may be able to influence merchants to use a 
4 s certain type of printer to be used with the DSC demonstration models. On the other hand, it would 

Sf be desirable if a mechanism were available for optimally matching DSCs to the particular printer 

y, used to output the images therefrom since this would allow consumers to differentiate DSCs on 

" m operational characteristics other than number of pixels. 

p*? 15 Various conventional systems and methods have been employed to address this 

C3 inconsistency between DSCs and printers. For example, U.S. Patent 6,01 1,547 describes a 

f I method and apparatus for reproducing an image from data obtained by a DSC. The DSC includes 

a recording information adding unit that is able to add recording information representing a 
recording condition. This information is specific to the DSC and contains information which varies 
20 at each recording. The data file that is output includes the image data as well as this recording 
information. However, limitations with this approach are that the recording information that is 
added, does not include parameters that are unique to the recording device. The output of the 
digital camera does not include a data file from the DSC with information about that recording 
device. Furthermore, it is presumed that the various printers are able to print images equally well, 
25 thus not needing to include information about the printer when the image is captured and transmitted 
by the DSCs for intermediate processing and subsequent production of a rendering of the image on 
the printer. 

Japanese publication JLOP 10-226139 describes a system and apparatus for capturing a 
digital photograph and including, with the photograph, selected information about what type of 
30 processing can be performed downstream, at a printer. Moreover, JLOP 10-226139 describes a 



digital picture input device that is able to hold printer control information. The printer control 
information includes a modality of the printer, and a combination of parameters used in a printing 
control processing to be performed by the printer Such as printing quality, image processing printing 
speed, masking and the like. The digital picture input device is able to specify which processing is to 
5 be performed in the printer when the image data is sent to the printer. The printing control 

information is useful at the DSC, when the digital picture input device is set to perform special image 
processing. When the special image processing is performed, compulsory printing control processing 
information is sent to the printer that will be suitable for the image processing performed by the 
% specific printer in association with the picture input device. This process is called "recommendation 

^ 10 printing control processing" that is performed by the digital picture input device. 

M A limitation with the approach provided in JLOP 1 0-226 1 39 is that it presupposes a 

l! particular printer with a particular printer control process to be used. The information output from the 

r " picture input device essentially controls the printing operation just as if an operator could do, if the 

C3 data was to be input at the printer itself It is presently recognized that a limitation with this approach 

u j 15 is that a one-to-one relationship exists between the printer that is to be printed and the DSC. 

S! Furthermore, a significant amount of data would be needed to be sent with each image file in order to 

(Sirs? 

H 5 control the printer modality and all of the printing parameters associated with the image processing to 

be performed at the printer. Since image file space is of key commercial, the present inventors have 
recognized that shorter files would be more optimum, especially files that provide parameters that 
20 merely adjust processes performed at the printer. In this Way, the DSC manufacturer, can identify 
optimum parameter settings that reflect a combination of both the DSCs characteristics, but also the 
printer's characteristics. 

SUMMARY OF THE ENVENTION 
25 The present invention was created to solve the aforementioned problems and limitations 

with conventional devices, and to generate an image file, as well as a signal that contains the image 
file, that can optimally reproduce an image at an output device and to obtain output results that reflect 
the intention of the photographer who generated the image data at the input device. 

A first embodiment of the present invention provides an image data generating apparatus to 
30 solve the aforementioned problems. The image data generating apparatus of the first embodiment of 
the present invention is characterized in that it comprises an image data generating mechanism that 



generates image data, an output process control information obtaining mechanism that obtains output 
process control information determined based on a combination of the image data generating 
apparatus and an output apparatus, with the output process control information being information 
that controls the output process for an output apparatus that outputs the image data , and an image file 
5 generating mechanism that combines and matches the generated image data and the obtained output 
process control information and generates an image file containing the same. With the image data 
generating apparatus of the first embodiment of the present invention, it is possible to generate an 
image file that coirelates (which should not be construed in a strict mathematical sense, such as 
"autocorrelation") output process control information and image data determined based on a 
10 combination of the image data generating apparatus that generates image files and the output 
apparatus and that stores the image data and output process control information. The output 
process control information is determined for each combination of image data generating apparatus 
and output apparatus, so it is possible to make suitable output results of image data at the output 
apparatus. 

15 For the image data generating apparatus of the first embodiment of the present invention, 

the output process control information can include information for controlling the image data 
reproduction characteristics at output device. In this case, it is possible to control reproduction 
characteristics according to the combination of the image data generating apparatus and the output 
apparatus. The output process control information can include gamma correction information for 

20 example. In this case, it is possible to give suitable gamma correction information to the output 

device according to the combination of characteristics of the image data generating apparatus and the 
output apparatus. Furthermore in addition to the output process control information, it is possible to 
store in the image file additional information that is correlated to the image data, the additional 
information including at least one item from among color space information, contrast information, 

25 color balance information, sharpness information, color correction information, shadow point 
information, highlight point information, brightness correction information, and highlight color 
information. In this case, it is possible to give each type of information to the output apparatus 
according to the combination of the image data generating apparatus and the output apparatus. 

The image data generating apparatus of the first embodiment of the present invention can 

30 further include an output process control information generating mechanism that generates the output 
process control information, and the output process control information obtaining mechanism can 
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obtain the generated output process control information. In this case, it is possible to suitably 
generate output process control information. 

The image data generating apparatus of the first embodiment of the present invention can 
further include an output process control information storing device that stores the output process 
5 control information, and the output process control information obtaining mechanism can obtain the 
stored output process control information. 

The second embodiment of the present invention provides an image data generating 
apparatus. The image data generating apparatus of the second embodiment of the present invention 
includes an image data generating mechanism that generates image data based on a subject, a first 

10 image obtaining mechanism that obtains first information for faithfully reproducing the color of the 
subject, the information reflecting the reproduction characteristics of the output device that outputs 
the generated image data, a second image obtaining mechanism that obtains second information for 
specifying any image quality adjustment process in relation to the image data at the output device, 
the information reflecting the reproduction characteristics of the output device, and an image file 

15 generating mechanism that generates an image file that stores the generated image data and the 
obtained first and second information. 

With the image data generating apparatus of the second embodiment of the present 
invention, it is possible to faithfully reproduce the color of the subject taking into consideration the 
reproduction characteristics of the output apparatus that outputs the generated image data, and it is 

20 possible to generate an image file that can specify any image adjustment process for image data at 
the output apparatus, taking into consideration the reproduction characteristics of the output 
apparatus. Therefore, it is possible to obtain the desired image output results when outputting an 
image file. 

For the image data generating apparatus of the second embodiment of the present invention, 
25 the first information can contain at least one information among gamma correction information, 
color space information, and negative image data value processing information. 

For the image data generating apparatus of the second embodiment of the present invention, 
the second information is information that reflects the color space conversion characteristics when 
converting image data color space to printing color space. In this case, it is possible to attempt to 
30 match the image data color space and printing color space. Also, the second information can 

include at least one information from among Shadow point information, highlight point information, 
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contrast information, brightness correction information, color balance information, saturation 
information, sharpness information, and stored color correction information. By including the 
concerned information, it is possible to specify any image adjustment process for image data at the 
output apparatus taking into consideration the reproduction characteristics of the output apparatus. 

For the image data generating apparatus of the first or second embodiment of the present 
invention, the image data generating apparatus can be a digital still camera. In this case, it is possible 
to generate output process control information according to the combination of the digital still 
camera and the output apparatus. 

The third embodiment of the present invention is directed to a digital still camera. The 
digital still camera of the third embodiment of the present invention is characterized in that it includes 
an image data generating mechanism that generates image data , an output process control 
information obtaining mechanism that obtains output process control information determined based 
on a combination of the image file generating mechanism and an output apparatus, with the 
information being information that controls the output process for an output apparatus that outputs 
the image data, and an image file generating mechanism that correlates the generated image data and 
the obtained output process control information and generates an image file to store the scene. 

With the digital still camera of the third embodiment of the present invention, it is possible 
to obtain the same effects as the image data generating apparatus of the first embodiment of the 
present invention. Also, the digital still camera of the third embodiment of the present invention 
can realize several specific varieties as can the image data generating apparatus of the first 
embodiment of the present invention. 

The fourth embodiment of the present invention provides a computer program product that 
generates an image file and an associated signal that is an of the image file that controls the output 
process for the output apparatus that outputs image data. The program of the fourth embodiment of 
the present invention is characterized in that the program uses a computer to realize an image data 
generating function, a function that obtains output process control information determined based on a 
combination of the output apparatus and an image data generating apparatus, the information 
controlling the output process for the output device, and a function that generates an image file that 
correlates the generated image data and the obtained output process control information and stores 
the same. 

With the program of the fourth embodiment of the present invention, it is possible to obtain 



the scene effects as the image data generating apparatus of the first embodiment of the present 
invention. Also, the program of the fourth embodiment of the present invention can be realized in a 
variety of embodiments as can the image data generating apparatus of the first embodiment of the 
present invention. 

5 The fifth embodiment of the present invention provides a program that generates an image 

file that controls the image process function for the output apparatus that outputs image data that was 
generated after capturing an image of a subject. The program of the fifth embodiment of the 
present invention uses a computer to realize a function for obtaining first information for faithfully 
reproducing the color of the subject, the infoimation reflecting the reproduction characteristics of the 
10 output device, a ftmction for obtaining second information for specifying any image quality 

adjustment process in relation to the image data at the output device, the information reflecting the 
reproduction characteristics of the output device, and a function that generates an image file that 
stores the obtained first and second information and identification information for identifying the 
output apparatus. 

15 With the computer program product of the fifth embodiment of the present invention, it is 

possible to obtain the same effect as with the image data generating apparatus of the second 
embodiment of the present invention. Also, the program of the fifth embodiment of the present 
invention can realize a variety of embodiments as does the image data generating apparatus of the 
second embodiment of the present invention. 

20 The sixth embodiment of the present invention provides an image processing device that 

executes image processing of image data using image the data and a process control data. The 
image processing device of the sixth embodiment of the present invention is characterized in that it 
includes a data retrieval mechanism that retrieves the image data and the process control data that 
include image process control infoimation determined based on a combination of the output 

25 apparatus and image data generating apparatus, and an image processor that performs image 

processing of the image data based on image process control information contained in the retrieved 
process control data. 

The image processing device of the sixth embodiment of the present invention can further 
include an image data output mechanism that outputs image data which has undergone the image 
30 processing. 

The seventh embodiment of the present invention provides an output apparatus that outputs 
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image data using image data, first information for faithfully reproducing the color of a subject 
considering the reproduction characteristics of the output apparatus, and second information for 
specifying any reproduction process on the image data at the output apparatus considering the 
reproduction characteristics of the output apparatus. The output apparatus of the seventh 
embodiment of the present invention is characterized in that it includes a data retrieval mechanism 
that retrieves the image data, the first information and the second information, a first reproduction 
process mechanism that executes reproduction processing on the image data to faithfully reproduce 
the color of the subject based on the first information, a second reproduction process mechanism that 
executes any reproduction process specified for the image data based on the second information, and 
an image data output mechanism that outputs image data which has undergone each of the 
reproduction processes. 

With the seventh embodiment of the present invention, it is possible to execute 
reproduction processing on image data so as to faithfully reproduce the color of the subject based on 
the first information, and to execute any reproduction process specified on the image data based on 
the second information, and to obtain the desired image output results that were anticipated when 
generating the image file. 

The eighth embodiment of the present invention provides an image output system for 
outputting image data using image files. The image output system of the eighth embodiment of the 
present invention is characterized in that it includes an image data generating mechanism that 
generates image data, an image process control information obtaining mechanism that obtains image 
process control information determined based on a combination of the output device and the image 
data generating device, the information controlling the image process at the output device that 
outputs the image data, an image data generating apparatus includes an image file generating 
mechanism that generates image files that correlate the generated image data and the obtained image 
process control infoimation and stores the scene, an image file fetching mechanism that fetches 
image files generated by the image data generating apparatus, an image processor that executes 
image processing of the image data based on image process control information included in the 
fetched image file, and an image processing device includes an output mechanism that outputs image 
data which has undergone the image processing. 

The eighth embodiment of the present invention provides an image output system for 
outputting image data using an image file. The image output system of the ninth embodiment of 



the present invention is characterized in that it includes ( 1 ) an image data generating device having: 
an image data generating mechanism that generates image data based on a subject, 
a first fetching mechanism that fetches first infomiation for faithfully reproducing the color 

of a subject, the information reflecting the reproduction characteristics of the output device that 

outputs image data, 

a second fetching mechanism that fetches second information for specifying any image 
quality adjustment processes for the image data at the output device, the information reflecting the 
reproduction characteristics of the output device, and 

an image file generating mechanism that generates image files that store the generated 
image data, and the fetched first and second information, and 

an image processing device including: 

an image file fetching mechanism that fetches the image files, 

a first reproduction processing mechanism that executes reproduction processing on the 
image data to faithfully reproduce the color of the subject based on the first information, 

a second reproduction processing mechanism that executes any reproduction process 
specified for the image data based on the second information, and 

an image data output mechanism that outputs image data which has undergone each of 
the reproduction processes. 

With the image output system of the ninth embodiment of the present invention, it is 
possible to use an image file having first information for faithfully reproducing the color of the 
subject taking into consideration the reproduction characteristics of the output device, and second 
information for specifying any color reproduction process for the image data at an output device 
taking into consideration the reproduction characteristics of the output device, and to realize an 
image output process that takes into consideration the color reproduction characteristics of the output 
device. 

DETAILED DESCRIPTION OF THE FIGURES 
Figure 1 is an explanatory diagram that conceptually shows the internal structure of an 
image file of a first working example according to the Present invention. 

Figure 2 is an explanatory diagram that schematically shows the image file GF of the fiist 
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working example stored in an Exif file format. 

Figures 3a and 3b are explanatory diagrams that show the detailed hierarchical structure of 
an image file GF of the first working example. 

Figure 4 is an explanatory diagram that shows an example of an image data output system 
5 that can use the image file GF of the first working example. 

Figure 5 is a block diagram that schematically shows a digital still camera that can generate 
an image file GF of the first working example. 

Figure 6 is a block diagram that schematically shows a printer that can process an image file 
GF of the first working example. 
10 Figure 7 is a flow chart that shows the image processing flow at a digital still camera 

according to a second working example. 

Figure 8 is a table that shows an example of output control information CI parameters and 
parameter values set at the digital still camera for the second working example. 

Figure 9 is a flow chart that shows the flow of the processing routine of a print process of a 
15 printer according to a third working example. 

Figure 10 is a flow chart that shows the flow of image processing of a printer according to a 
third working example. 

Figure 1 1 is a flow chart that shows the image processing of a printer as a fourth working 
example. 

20 Figures 12 through 14 describe several signal processing expressions performed according 

to the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 
Now, turning to the figures a description will be provided in the following sequence of 
several working examples of an image data output system that generates and processes image files 
25 according to the present invention. 

A. Structure of an Image File as a First Working Example 

B. Structure of an Image Data Output System That Can Use Image Files 

C. Image Processing by a Digital Still Camera as a Second Working Example 

D. Image Processing by a Printer as a Third Working Example 
30 E. Image Processing by a Printer as a Fourth Working Example 
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F. Other Working Examples 



A. Structure of an Image File as a First Working Example 

Figure 1 is an explanatory diagram that conceptually shows the internal structure of an 
image file of the first working example. Image file GF (10) includes image data storage area 101 
that stores image data GD and control information storage area 102 that stores output control 
information CI. Image data GD can be stored in JPEG format, for example, and output control 
information CI can be stored in TIFF format. The terms "file structure ," "data structure," and 
"storage area" in this working example mean a file or data field configured to hold a digital 
representation of an image when a file or data, etc. is stored within a certain storage range of a 
storage device. 

Output control information CI is information that specifies the image output conditions and 
image output status for an output device so as to be able to obtain the optimum image output results 
according to a combination of the input device, such as a DSC, and output device, such as a printer. 
Specifically, it is information for controlling image processing at the output device and perhaps at an 
intermediate processing stage, such as in a personal computer so that the image data GD has a 
correct color reproduction determined based on the combination of the input device image data GD 
generating characteristics and the output device image data GD color reproduction characteristics. 
The output control information is equipment-type dependent information for the input device and 
output device. Information stored as output control information CI can include as image 
characteristic related information, for example, parameters related to gamma values or the target 
color space, and parameters relating to stored color correction such as shadow points, highlights, 
brightness, saturation, contrast, color balance adjustment, sharpness, and stored color correction, 
and as information relating to printer operation control, can include parameters relating to paper 
quality, resolution, and printer head operating direction (single direction printing or bi-directional 
printing). 

The aforementioned image file GF of this working example is generated by, for example, a 
digital still camera (DSC), but a digital video camera (DVC), or input device such as a scanner 
(image file generating device) could be used as well. 

The image file GF of this working example includes, at a minimum, the aforementioned 
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image data area 101 and control information storage area 102, and can take file structures 
according to already standardized file formats. Below a case is explained when the image file GF 
of this working example is applied to a standardized file format. 

The image file GF of this working example can have a file structure according to a digital 
5 still camera image file format standard ("Exlf ') for example. The Exlf file specifications are 

determined by the Japan Electronics & Information Technology Industries Association (JEITA). 
Referring to figure 2, the schematically structure will be explained of a file interior when the 
image file GF of this working example has a file format according to this Exlf file format. Figure 
2 is an explanatory diagram that schematically shows the image file GF of a working example 

1 0 stored in an Exlf file format. 

Image file 1 1 ? as an Exlf file, includes JPEG image data storage area 111 that stores JPEG 
format image data, and additional information storage area 1 12 that stores various types of 
information relating to the stored JPEG image data. Stored in additional information storage area 
1 12 is shooting time information relating to the JPEG image shooting conditions such as shooting 

15 date and time, exposure, and shutter speed, etc., and JPEG image thumbnail image data stored in 
JPEG image data storage area 1 1 is stored in TIFF format. Also, additional information storage 
area 1 12 has "Makernote" data storage area 1 13 which is an undefined area left open for DSC 
manufacturers, and the output control information CI of this working example is stored in 
Makernote data storage area 113. Also, as is known by those in the industry, with Exlf format 

20 files, a tag is used to characterize each data, and Makernote is allocated as the tag name for data 
stored in Makernote data storage area 1 1 3, and this is called a Makernote tag. 

Referring now to Figures 3a and 3b, a detailed explanation of the data structure of 
Makernote data storage unit 1 13 is provided. Figures 3a and 3b are explanatory diagrams that 
show the detailed hierarchical structure of an image file GF of this working example. Figure 3a 

25 shows the data structure of Makernote data storage area 1 13 (image output control data storage 
area), and Figure 3b shows PrintMatching data storage area (image output control parameter 
storage area) 1 14 that is defined within Makernote data storage area 113. 

The Makernote data storage area 1 13 of the image file GF of this working example also 
has a structure that allows it to identify stored data by tags, and the PrintMatching tag is allocated 

30 to output control information CI. Each tag of Makernote data storage area 1 13 is specified by a 
pointer with an offset value from the top address of Makernote data storage area 113. The 
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information stored in Makernote data storage area 113 is the maker name in the top address (6 
bytes), followed by the reserve area (2 bytes), the local tag entry count (2 bytes), and each local tag 
offset (12 bytes). After the maker name, a 00x0 end code that shows the end character string is 
attached. 

5 The information stored in PrintMatching data storage area 1 14 is the PrintMatching 

identifier that shows a PrintMatching parameter is stored, a parameter specification count that 
shows the number of parameters specified, a parameter number in which is stored the value that 
specifies (identifies) the parameter number allocated in advance for each parameter, and the 
parameter setting value in which is stored parameter setting values of the specified parameter 

10 number. The parameter number can be, for example, information stored in a 2 byte area, and the 
parameter setting values can be information stored in a 4 byte area. As parameter numbers, for 
example, 1 can be allocated for the gamma value parameter, 7 can be allocated for the shadow 
point parameter, and 9 can be allocated for the contrast point parameter. As will be described later, 
on the output device side, it is possible to obtain the output control information CI (each parameter 

15 value) with this PrintMatching tag as an index. 

As described above, the image file of this working example includes image data GD and 
output control information CI within one file, so it is possible to specify image output conditions such 
as gamma value, target color space, contrast, sharpness, and brightness to the output device with 
just one image file. Therefore, for example, by specifying the gamma value to an output device, it is 

20 possible to reduce the difference in brightness, contrast, etc. between the display image confirmed 
on a digital still camera monitor and the output image output using an output device such as a 
printer. DSC manufacturers are best suited to identify the optimal processing settings by observing 
the results of the DSC when used with a particular printer. This identification of what combination 
of DSC parameters and printer parameters is largely found through a trial and error process. Also, 

25 there can be multiple PrintMatching data to correspond to multiple output devices having different 
output characteristics. 

Also, it is possible to specify the target color space. In the past, the de facto color space 
was fixed at sRGB, and so even when the digital still camera is capable of producing image data 
using color space that is broader than NTSC, sRGB, etc., the present inventors recognized that it is 
30 possible to effectively output broad color space and not lose the color information in downstream 
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signal processing. Moreover, the present inventors recognized that it is desirable to output the 
image data in a color space that is larger than an SRGB color space, even if a SRGB transformation 
is performed in downstream processing since it is possible to do further color space processing to 
avoid losing the color information that would otherwise be lost in the SRGB transformation. 
5 Furthermore, it is possible to specify the DSC operator's likes (image characteristics) such 

as sharpness and brightness as output control information during output, so it is possible to obtain 
the intended output results without need for separate photo retouching work. 
Also, there is no need to interpose a device for photo retouching, so this advantage is especially 
useful for output devices equipped with functions that can be processed with a single image file. 

10 Furthermore, it is possible to use a file to specify the printing processing conditions to the printer 
such as paper quality (paper type), resolution, and printing head operating direction which were set 
using the printer driver setting screen in the past, so it is possible to solve problems of insufficient 
settings of printing processing conditions that could not be resolved only by correction of printing 
data image quality characteristics. As a result, it is possible to print image data using printing 

15 processing conditions that are suitable for the image quality characteristics, so it is possible to 

achieve printing results that more accurately reflect the intention of the person who generated the 
image file. In this way, the DSC manufacturer goes through the laborious process of identifying the 
optimum combination of operational characteristics of a DSC-printer pair, and memorizes the 
characteristics in memory, for later retrieval when the photographer identifies the target printer to be 

20 used for printing. By following this approach, the DSC vendor does the matching once, so 

thousands of DSC photographers never have to do it, yet the photographers can be guaranteed that 
the results will he optimal for the DSC-printer pair. 

B. Structure of an Image Data Output System That Can Uses Image Files 

Figures 4 through 6 will now be referred to while explaining the structure of an image data 
25 output system that can use the image file GF of this working example. Figure 4 is an explanatory 

diagram that shows an example of an image data output system that can use the image file GF of the 
first working example. Figure 5 is a block diagram that shows the schematic structure of a digital 
still camera that can generate an image file GF of the first working example. Figure 6 is a block 
diagram that schematically shows a printer that can process an image file GF of the first working 
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example. 

Image data output system 20 includes a digital still camera 22 as an input device that 
generates image files GF, and printer 24 as an output device that outputs images based on image 
files GF generated by digital still camera 22. As an output device, besides the printer 24, it is also 
possible to use a monitor 25 such as a CRT display or LCD display, or to use a projector or the 
like, but in the explanation that follows, the printer 24 is used as the output device. 

Digital still camera 22 is a camera that obtains images by forming images from light 
information in a digital device (CCD or photo multiplier), and as shown in figure 5, includes optical 
circuit 221 for gathering light information, image obtaining circuit 222 for controlling a digital device 
to obtain an image, image processing circuit 223 for processing the obtained digital images, and 
control circuit 224 for controlling each circuit. Digital still camera 22 saves the obtained images as 
digital data in storage device 225 which is shown to be optionally removable. The DSC 22 may 
also include an I/O port, such as a USB, IEEE 1394 port, or a wireless port, such as IR or RF, 
(e.g., Bluetooth compatible). When a "wired" communication channel is used, such a coaxial cable, 
for outputting the resulting image file, the propagated data signal sent over the channel as an electric 
signal. When transmitted over a wireless channel, the propagated data signal is sent as an 
electromagnetic signal. As a data structure format for saving the image data GD in digital still 
camera 22, a JPEG format is typical, but it is also possible to use other saving formats such as 
TIFF, GIF, BMP, and RAW. DSC 22 also includes select and determine button 226 for selecting 
and setting output control information CI. 

In addition to image data GD, the DSC 22 used in this image data output system 20 stores 
output control information CI as an image file GF in storage device 225. Output control information 
CI can be automatically stored in storage device 225 as an image file GF together with image data 
GD when obtaining image data GD by setting in advance the output device planned for output or by 
setting in advance any output conditions on DSC 22 before shooting. Or, during shooting, once 
image data GD only is stored in storage device 225 as an image file GF, by specifying use of any 
desired output conditions or use of preset conditions on DSC 22 after shooting, it is also possible to 
add the specified output conditions to an image file GF as output control information CI. 

Preset conditions can be, for example, output conditions to match the output device that 
outputs the image data GD in an image file GF, output conditions optimized for each manufacturer 
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of printer 24 or for each equipment type of printer 24, or it can be general use output conditions that 
are used fairly often such as bright, sharp, etc. These preset conditions are held in memory within 
control circuit 224 of digital still camera 22 as information such as the gamma value, target color 
space contrast, and sharpness, etc. The present conditions may be identified by the DSC 
5 manufacturer and presented in an option menu to an operator of the DSC. 

"Output conditions" means output conditions set by the user on digital still camera 22 (image 
processing circuit 223), and is information set as the user chooses such as the gamma value, target 
color space, contrast, and sharpness. 
£3 Image file GF generated by DSC 22 is sent to printer 24 via, for example, cable CV (e.g., 

y3 10 USB or IEEE 1394) and computer PC, or via cable CV or by a wireless communications channel 
U such as IR or ( e -g*> Bluetooth). An output signal containing the Exif image file with PIM 

parameter is sent in either an electric (wired channel) or an electromagnetic (wireless, optical 
M channel). When the storage device 225 of DSC 22 is a detachable storage device, image file GF is 

G sent to printer 24 via a personal computer (PC) to which the storage device 25 is connected, or by 

2 1 5 directly connecting storage device 225 to printer 24. With the explanation that follows, the 
;!f explanation is based on a case when storage device 25 is detachable, and is connected directly to 

H printer 24. Although the communication channels may be used as an alternative to the detachable 

storage device 25 for transferring the data image file from the DSC 22 to an output device, perhaps 
by way of an intermediate processing device. 
20 Printer 24 can be an inkjet printer that forms an image by forming a dot pattern by spraying 

four colors of ink such as cyan (C), magenta (M), yellow (Y), and black (K) onto a printing 
medium, or it can be an electrophotographic printer that forms an image by transferring and fixing 
color toner onto a printing medium. As shown in figure 6, printer 24 includes printing unit 241 that 
executes print processing onto a printing medium including the printing head or rotating drum, etc., 
25 slot 242 that holds storage device 225, and control device 246 that analyzes output control 

information CI read from storage device 225 and controls the operation of each part of printer 24 
based on the analyzed output control information. Control device 246 includes processing device 
(CPU) 30 that executes various arithmetic processes, read only memory (ROM) 31 that performs 
non-volatile storage of the programs, etc. executed by CPU 30, and random access memory 
30 (RAM) 32 that temporarily stores processing results of CPU 30 and obtained data. The detailed 
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image processing flow executed by control device 246 will be described later. 

C. Image Processing by a Digital Still Camera as a Second Working Example 

Referring now to Figures 7 and 8, Figure 7 is a flow chart that shows the image processing 
flow at digital still camera 22 according to a second working example. Figure 8 is a table that shows 
5 an example of output control information CI parameters and parameter values set at digital still 
camera 22 for the second working example. 

Control circuit 224 of digital still camera 22 decides whether preset control information is 
set by the user before taking a picture (step SI 00). As has already been explained, information that 
can be set as preset control information includes output conditions to match the output device that 
10 outputs the image data GD in an image file GF, output conditions optimized for each manufacturer 
of printer 24 or for each equipment type of printer 24, or it can be general use output conditions that 
are used fairly often, such as bright, sharp, etc. This information (conditions) is set by a user 
selecting from choices prepared in advance, and there is no requirement for the user to make fine 
settings. 

15 When it is decided that preset control information is set (step SI 00: Yes), control circuit 

224 generates image data GD (step S110) according to a shooting request, for example when the 
shutter button is pressed. Control circuit 224 stores the generated image data GD and the set preset 
control information as an image file GF in storage device 225 (step S 120). The data generated at 
DSC 22 is expressed by the YCbCr color space. 

20 In contrast to this, when it is decided that preset control information is not set (step SI 00; 

No), control circuit 224 generates image data GD according to the shooting request (step S 130), 
and stores the generated image data GD as an image file GF in storage device 225 (step S140). 

Control circuit 224 determines whether the specification of any image output condition after 
shooting has been executed (step SI 50). When it is determined that the specification of any image 

25 output condition after shooting has been executed (step SI 50: Yes), control circuit 224 adds the 
specified image output conditions to the image file GF stored in storage device 225 (step SI 60), 
and ends the main processing routine. Meanwhile, when it is determined that the specification of any 
image output condition after shooting has not been executed (step SI 50: No), control circuit 224 
adds preset automatic adjustment conditions to the stored image file (step S170) and ends the main 

-18- 



processing routine. 

With the above processing executed at DSC 22, the output control information CI that 
specifies output conditions for printer 24 is provided together with image data GD to image file GF 
stored in storage device 225. As shown in Figure 8, as conditions that can be specified as any 
image output condition, the value of each parameter is set. The meaning held by each parameter is 
known by those in the industry, so the following discussion will explain only the parameters that 
have a strong relationship with this working example. 

The target color space (first information) is a parameter for matching the image on the 
shooting side and the image on the printer side by having the XYZ color space as a common color 
space between the shooting side and printing side, and defining the color range that was shot and 
submitting this to the printer side within this color space. The digital still camera shot image is 
normally print processed using the sRGB color space regardless of the color space held by the 
digital still camera. Therefore, even in a case when the digital still camera generates an image using a 
broader NTSC color space than the sRGB color space, the printing processing must be executed 
using the narrower color space, and in the past it was not possible to use the broad color space 
effectively. The parameters of the target color space in this working example specify the color space 
to be used by the printer during printing, so this problem is solved. 

The sRGB negative value processing parameter (first information) is a parameter that 
specifies whether to handle negative values that appear among the RGB values or positive values 
that exceed 255 as valid data. When a value of 1 is taken for this parameter, negative values are 
handled as valid, and when a value of 0 is used, negative values are handled as invalid. Therefore, 
when this parameter is set to 1, image processing that uses negative RGB values (values other than 
in the 0 to 255 range) can be used at the printer to more accurately reproduce color. In many 
conventional systems the negative values are "clipped/ 1 

As described above, with a DSC 22 according to this working example, it is possible to 
generate the image file GF of this working example. Therefore, it is possible to use DSC 22 to 
preset image output conditions considering color reproduction characteristics of the output device, 
and to control the image output status at the output device. Especially when the color space that can 
be expressed by DSC 22 is broader than the sRGB color space typically used for image processing 
from the past, the image generated by DSC 22 was not output correctly at the output device, but by 
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specifying the color space that DSC 22 has as the target color space, it is possible to make the 
color reproduction accurate. It is also possible to obtain output results that effectively use the color 
reproduction capability of DSC 22. Also, this working example used as an example a digital 
camera, but it also possible to apply this to an application program executed on a personal 
5 computer, palm-top computer, or other processor-based device that hosts application software. In 
this case, instead of generating image data GD, image data GD is obtained from a digital camera, 
and is stored together with the output control information CI generated by the application program 
in one image file GF. 

D. Image Processing by a Printer as a Third Working Example 

10 Figure 9 is a flow chart that shows the processing routine of a print process of printer 24 

according to a third working example. Figure 10 is a flow chart that shows the flow of image 
processing of printer 24. 

When storage device (memory card) 225 is inserted into slot 247, control device 246 
(CPU 30) of printer 24 reads image file GF from storage device 225, and temporarily stores the 

15 read image file GF in RAM 32 (step S200). CPU 30 searches (step S202) for the maker name 
(00x0 tag) of the read image file GF across 20 bytes from the top address of Makernote data 
storage area 1 13. The maker name is noted within 20 bytes from the top address within Makemote 
data storage area 113. When the maker note is found (step S204: Yes), CPU 30 adds 2 bytes of 
offset to the current pointer (step S206). 

20 When CPU 30 could not find a maker name (step S204: No), it returns to the top address 

of the Makernote of the current pointer (step S208). This is to deal with cases when a maker name 
was never noted. In this case, a reserve area is allocated at the top address, so by returning the 
pointer to the top address, the pointer can be placed at the same position as when a maker name is 
found. CPU 30 interprets 2 bytes of information from the current pointer as the tag entry count to 

25 obtain a tag entry count (step S210). As already described, Makernote data storage area 1 13 

stores 2 bytes of local tag entry count information sandwiched by 2 bytes of reserve area after the 6 
byte maker name information, so CPU 30 can interpret as noted above. 

CPU 30 searches for local tags by the same amount as the number of obtained tag entries 
(step 3212), and decides whether or not there is a PrintMatching tag (step S214). When a 
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PrintMatching tag is found (step S214: Yes), CPU 30 obtains the output control information CI 
stored in PrintMatching data storage area 114 and analyzes the control information, and then 
obtains the control parameter values (step S21 6). CPU 30 executes the image processing to be 
described later (step S21 8) based on the control parameter values obtained from the analyzed 

5 output control information CI, and prints out the processed image data (step S220). 

When a PrintMatching tag is not found (step S214; No), CPU 30 re-searches the 
PrintMatching tag code using a stipulated fixed offset value (step S222). This is to deal with cases 
when there is an error in interpreting the local tag entry count. CPU 30 searches for PrintMatching 
tags again (step S224), and when a tag is found (step S224: Yes), the processes after step S216 

10 that have already been described are executed. Meanwhile, when CPU 30 does not find a 

PrintMatching tag (step S224: No), printer 24 obtains the pre-held image processing information 
from ROM 3 1 and executes normal image processing (step S226). CPU 30 prints out the 
processed image data (step S220) and ends the main processing routine. 

Referring now to Figure 10, the printer's control device 246 (CPU 30) fetches image data 

15 GD from the read image-file GF (step S300). As was explained previously, DSC 22 saves the 
image data as a JPEG format file, and with JPEG files image data is saved using YCbCr color 
space to increase the compression rate. 

CPU 30 executes 3x3 matrix operation S to convert image data based on the YCrCb 
color space to image data based on RGB color space (step S3 10), Matrix operation S is the 

20 operation expression shown Figure 12. When executing this matrix operation S, CPU 30 

references the sRGB negative value processing parameter from among the already described 
parameters, and when the sRGB negative value processing parameter value is set to 1, in other 
words, when the parameter is enabled, when RGB after conversion is a negative value, or even 
when it is a positive value other than the expressed color range of the sRGB color space (e.g. 256 

25 or greater when there are 256 gradations), CPU 30 saves the obtained RGB value as is. 

Meanwhile, when the sRGB negative value processing parameter value is set to 0, in other words 
when it is disabled, when the RGB obtained after conversion has a negative value, CPU 30 saves 
the RGB value with the negative value as 0, and when it has a value 256 or greater, it saves it as 
255. This later process "clips" the later data that is outside the sRGB range. 

30 CPU 30 executes gamma correction and matrix operation M on the RGB color space 
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image data obtained in this way (step S320). The process executed here is a process executed 
according to the control parameters within output control information CI. When executing gamma 
correction, CPU 30 references the digital still camera side gamma value among the previously 
described parameters, and executes gamma conversion processing on video data using the set 
5 gamma value. Matrix operation M is an operation for converting RGB color space to XYZ color 
space. When executing matrix operation M, to reflect the specified target color space, CPU 30 
references the target color space of the already described parameters, and using a matrix (M) that 
corresponds to the set color space, NTSC for this working example, it executes the matrix 
operation. More specifically, it references the target color space tab, and by obtaining each matrix 

10 value of matrix (M), it executes a matrix operation using matrix (M). Matrix operation M is the 
operation expression shown in Figure 13. 

The color space of the image data GD obtained after executing matrix operation M is an 
XYZ color space. This is to attempt to match the color space expressed by image data GD and the 
color space on the printer side via the XYZ color space which is an absolute color space. In the 

15 past, the color space used when doing image processing on a printer or computer was fixed as 
sRGB, and it was not possible to effectively use the color space that DSC 22 has. In contrast to 
this, with this working example, output control information CI that specifies a target color space to 
the printer, etc. is given to image file GF, and a printer (printer driver) is used that changes the 
matrix (M) used for matrix operation M to correspond to the specified target color space. 

20 Therefore, it is possible to effectively use the color space that DSC 22 has, and to realize correct 
color reproduction. 

To execute image adjustments based on other output control information, CPU 30 executes 
a process to convert the image data GD color space from an XYZ color space to a wRGB color 
space, specifically, it executes matrix operation N" 3 and reverse gamma correction (step S330). The 

25 wRGB color space is a broader color space than the sRGB color space. When executing gamma 
correction, CPU 30 references the printer side gamma value within the already described 
parameters, and executes reverse gamma conversion processing on video data using an inverse 
number of the set gamma value. When executing matrix operation N" 1 , CPU 30 executes a matrix 
operation using a matrix (N" 1 ) corresponding to converting from ROM 3 1 to a wRGB color space. 

30 Matrix operation N" 1 is the operation expression shown in Figure 14. 
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The color space of the image data GD obtained after executing matrix operation N" 1 is a 
wRGB color space. As described previously, this wRGB color space is a broader color space than 
the sRGB color space, and corresponds to the color space that can be generated by DSC 22, 

CPU 30 executes automatic image quality adjustment to characterize an image (step S340). 
5 The process executed here is also a process executed according to the control parameters within 
output control information CI. When executing automatic image quality adjustment, CPU 30 
analyzes image data GD and obtains the characteristic parameter values that show the image quality 
of the image data GD. Then, CPU 30 references parameter values such as brightness and sharpness 
from among the control parameters, and corrects that standard parameter values set in advance in 

10 relation to each characteristic parameter based on the referenced control parameter values. CPU 
30 corrects the characteristic parameter values so as to approach the corrected standard parameter 
values and executes image quality adjustment on video data. The values given to each parameter of 
the output control information CI for this working example are as shown in the table in figure 8. As 
control parameters, it is possible to have parameters formed from multiple control parameters while 

15 at the same time having different parameters for each scene for which the control parameter values 
are changed for each shot scene. 

When performing automatic image quality adjustment, when correcting color balance, this 
can be done by, for example, obtaining the average value of each RGB component, correcting the 
obtained average values based on the control parameters, and obtaining the color skew of each 

20 component value in relation to the corrected average values to reflect them in the image data. Also, 
when correcting contrast, this can be done, for example, by obtaining the luminosity y for the pixels 
of the image data, and considering the control parameters, for the top and bottom edges, viewing 
the edge that entered inside by the amount of a specified distribution ratio as the luminosity 
distribution edge, and thus obtaining a parameter that corresponds to the expansion rate within a 

25 range for which luminosity reproduction is possible and parameter b that corresponds to the offset 
volume, and by using a relational equation for which Y — a y + b for the conversion destination 
luminosity Y in relation to conversion source luminosity y, contrast is corrected automatically. 

CPU 30 references output control information CI, obtains the parameters relating to the 
type of printing medium (paper), resolution, and printing direction (one directional printing or bi- 

30 directional printing), for example, and sets the printing conditions for the printer driver (step S350). 
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When the printing subject is a photograph, photographic paper is set as the paper, photo mode is 
set as the resolution, and bi-directional printing is set to off (in other words, one directional printing). 
]n this way, the printer driver setting conditions are set based on output control information CI, so it 
is not necessary for the user who is executing the printing to set these conditions in the printer driver 
5 setting screen. 

CPU 30 executes wRGB color conversion processing and half tone processing for printing 
(step S360). With wRGB color conversion processing, CPU 30 references the look up table (LUT) 
for conversion to the CMYK color space corresponding to the wRGB color space stored in ROM 
3 1 , and changes the image data color space from a wRGB color space to a CMYK color space. 

10 Specifically, the image data composed from the R, G, and B gradation values is converted to data 
of the six color gradation values of C, M, Y, K, LC, and LM, for example, that are used with 
printer 24. This conversion look up table includes one element that determines the color 
reproduction characteristics of color printer 20. 

With halftone processing, color converted image data is received, and gradation count 

15 conversion processing is performed. For this working example, the image data after color 

conversion is expressed as data that has 256 gradation width for each color. In comparison to this, 
with printer 24 of this working example, it is only possible to achieve a state of either "form dots" or 
"do not form dots". Specifically, printer 24 can only express 2 gradations locally. Thus, image data 
that has 256 gradations is converted to image data that is expressed in 2 gradations that can be 

20 expressed by printer 24. As a representative method of this 2 gradation (binarization) processing, 
there is a method called the error diffusion method and a method called the systematic dither 
method. 

At printer 24, before doing color conversion processing, when the image data resolution is 
lower than the printing resolution, linear interpolation is performed and new data is generated 

25 between adjacent image data, and when conversely it is higher than the printing resolution, by 

thinning out the data at a constant ratio, resolution conversion processing is executed that converts 
the image data resolution to the printing resolution. Also, printer 24 executes an interlace process 
that changes the sequence of image data that has been converted to the format that expresses 
whether dots are formed from the order it was to be transferred to color printer 20, 

30 With this working example, all image processing is executed at printer 24, and a dot pattern 
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is formed on a printing medium according to the generated image data, but all or part of the image 
processing can be executed on a computer as well. In this case, this is realized by giving the image 
processing functions explained with reference to Figure 10 to the image data processing application 
installed in the hard disk, etc. of the computer. Image files GF generated by DSC 22 are provided 
5 to the computer via a cable or via storage device 225. On the computer, the application is started 
by an operation by the user, the image files GF are read, output control information CI is analyzed, 
and image data GD conversion and adjustment are executed. Or, this can also be done by detecting 
the insertion of storage device 225, or by detecting the insertion of a cable, starting the application 
automatically, reading the image files GF, analyzing output control information CI, converting image 

10 data GD, and making adjustments automatically. 

As described above, with the image processing of the first working example on printer 24 
according to this working example, the output control information CI within the image file GF, 
specifically the gamma value, gamma value for printer 24 according to the target color space, and 
the target color space which are control parameter values are set based on the combination of DSC 

15 22 and color printer 24. Also, the concerned output control information CI is information that takes 
into consideration the color reproduction characteristics of printer 24. Therefore, it is possible to 
reduce or eliminate the differences between the image data reproduced at DSC 22 that generates 
image files GF and the image data reproduced at printer 24, and the image data can reproduce 
colors accurately. Also, by having an RGB-CMYK color conversion table that corresponds to the 

20 color space that can be expressed by the digital still camera, it is possible to more accurately output 
(print) the image data GD generated by the digital still camera. 

Also, it is possible to specify parameters that show the intention of the image shooter such 
as sharpness and brightness to characterize the image as output control information CI, so when 
image file GF is generated, it is possible to realize the desired image preferences without doing 

25 photo retouching work. 

Also, the printing conditions of printer 24 are set based on output control information CI, so 
it is not necessary for the user to set printing conditions such as type of printing medium, resolution, 
and printing direction on the printer driver setting screen. Also, there is no longer any risk of the user 
making unsuitable printing condition settings in the image data, so it is possible to prevent the 

30 decrease in printing quality due to unsuitable printing condition settings. Therefore, users can more 
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reliably obtain the printing results intended by the person who generated the image file. 

In any case, it is possible to specify printer output characteristics on the image file GF 
generating side, in other words on the digital still camera side, and it is possible to obtain the 
specified printing results, or the assumed printing results. 

5 E. Image Processing by a Printer as a Fourth Working Example 

Image processing at printer 24 can also be executed in the processing sequence shown in 
Figure 11. Specifically, automatic image quality adjustment can be executed first. Figure 1 1 is a flow 
chart that shows the image processing of a printer as a fourth working example. Except for the fact 
that the image processing procedure differs from that of the third working example, the hardware 

10 structure, etc. is the same as that of the third working example including the printer 24 hardware 
structure, etc., so the same code numbers were used and we are omitting an explanation of these 
here. 

The printer's control device 246 (CPU 30) fetches image data GD from a read image file 
GF (step S400), DSC 22 saves the image data as a file in JPEG format as described previously, 

15 and with JPEG files image data is saved using YCbCr color space to increase the compression rate. 

CPU 30 executes automatic image quality adjustment to characterize the image (step 
S410). When executing automatic image quality adjustment, CPU 30 analyzes image data GD and 
obtains the characteristic parameter values that show the image quality of the image data GD, Then, 
CPU 30 references parameter values such as brightness and sharpness from among the control 

20 parameters, and executes image adjustment on video data using the set parameter values (see 

Figure 8 as an example). For automatic adjustment of an image, the standard parameter values are 
corrected based on the control parameter values, and correction of the image data GD 
characteristics parameter values is as described previously. Image data GD which reflects the image 
adjustment results are represented by the Y'Cb'Cr' color space. 

25 CPU 30 executes 3x3 matrix operation S to convert Y'Cr'Cb 1 color space image data to 

RGB color space image data (step S420), Matrix operation S is the operation expression as 
previously described. 

When executing this matrix operation S, CPU 30 references the sRGB negative value 
process parameters among the already described parameters, and executes processing according to 
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the parameters. 

CPU 30 executes gamma correction and matrix operation M on the RGB color space 
image data obtained in this way (step S430). The process executed here is a process executed 
according to the control parameters within output control information CI. When executing gamma 

5 correction, CPU 30 references the digital still camera side gamma value among the previously 
described parameters, and executes gamma conversion processing on video data using the set 
gamma value. When executing matrix operation M, CPU 30 references the target color space of the 
already described parameters, and using a matrix (M) that corresponds to the set color space, 
NTSC for this working example, it executes the matrix operation. Matrix operation M is the 

10 operation expression shown below. 

The color space of the image data GD obtained after executing matrix operation M is an 
XYZ color space. To execute image adjustments based on other output control information, CPU 
30 executes a process to convert the image data GD color space from an XYZ color space to a 
wRGB color space, specifically, it executes matrix operation N" 1 and reverse gamma correction 

15 (step S440). As has already been described, the wRGB color space is a broader color space than 
the RGB color space. Matrix operation N" 1 is the operation expression described previously. 

The color space of the image data GD obtained after executing matrix operation N" 1 is a 
wRGB color space. As described previously, this wRGB color space is a broader color space than 
the sRGB color space, and corresponds to the color space that can be generated by DSC 22. 

20 CPU 30 references output control information CI, obtains the parameters relating to the 

type of printing medium (paper), resolution, and printing direction (one directional printing or bi- 
directional printing), for example, and sets the printing conditions for the printer driver, and executes 
wRGB color conversion processing and half tone processing for printing (step S450), The wRGB 
color conversion processing and half tone processing are the same image processing as for the first 

25 working example, so we will omit an explanation of these here. 

At printer 24, before doing color conversion processing, when the image data resolution is 
lower than the printing resolution, linear interpolation is performed and new data is generated 
between adjacent image data, and when conversely it is higher than the printing resolution, by 
thinning out the data at a constant ratio, resolution conversion processing is executed that converts 

30 the image data resolution to the printing resolution. Also, printer 24 executes an interlace process 
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that changes the sequence of image data that has been converted to the format that expresses 
whether dots are formed from the order it was to be transferred to color printer 20. 

For the image processing at printer 24 of the fourth working example as well, it is possible 
to obtain the same effects as those obtained for the image processing of the third working example. 

5 F. Other Working Examples 

For both the aforementioned third and fourth working examples of image processing, printer 
24 was used as the output device, but it is also possible to use a display device such as a CRT, 
LCD, or projector as the output device. In this case, depending on the display device used as the 
output device, an image processing program (display driver) that executes image processing like 

10 that explained using figures 9 and 10, for example, is executed. Or, when a CRT or the like is 

functioning as the display device of a computer, an image processing program is executed on the 
computer side. However, the finally output image data has an RGB color space rather than a 
CMYK color space. 

In this case, as with being able to specify printing results via printer 24 using image file GF, it 
15 is possible to specify display results for the display device such as a CRT using image file GF. 
Therefore, by giving suitable parameters for the display device such as a CRT to output control 
information CI of the image file GF, and by giving the optimal parameters to the display 
characteristics of each display device, it is possible to more accurately display image data GD 
generated by DSC 22. 

20 Also, with each of the aforementioned working examples, we explained an example with 

output control information (PrintMatching data) stored in one output device within an image file, but 
it is also possible to store output control information for multiple output devices with different output 
characteristics in an image file GF. In this case, by providing a function that identifies and obtains 
PrintMatching data specified itself by each output device from one image file GF, it is possible to 

25 execute image processing and image output control of image data GD based on the obtained 

PrintMatching data. Therefore, it is possible to control suitable image output status for multiple 
output formats. 

Above, image files, image file generating devices, and output devices that can use image files 
that relate to the present invention were explained based on working examples, but the preferred 
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embodiments of the invention noted above are for making the present invention easy to understand, 
and do not limit the present invention. The present invention can of course be changed and 
improved without straying from the gist and claims of the invention, and it goes without saying that 
the present invention also includes equivalent items. 

With the aforementioned working examples, the parameters of gamma value, target color 
space, and sharpness sere used as the output control information CI, but what kind of parameter is 
used for output control information can be decided freely. 

Also, each parameter value shown as an example in the table in figure 8 is nothing more 
than an example, and the invention of this application is not limited by these values. Furthermore, the 
values for matrices S, M, and N" 1 for each expression are nothing more than examples, and it goes 
without saying that it is possible to make suitable modifications by the targeted color space or the 
color space that can be used at printer 24, etc. 

With the aforementioned working examples, a case was also explained using a DSC 22 as 
the image file generating device, but besides this it is also possible to use a scanner or a digital video 
15 camera, etc. When using a scanner, the specification of the output control information of image file 
GF can be executed on a computer PC, or a preset button with preset information allocated to them 
or display screen and setting buttons to make any desired settings can be provided on the scanner 
for setting information, so that execution can be performed from the scanner alone. 

The color spaces used in the aforementioned working examples are nothing more than 
20 examples, and other color spaces can also be used. In any of these cases, what is required is that 
the image file generated on the image file generating device side be able to obtain the assumed 
output results or the specified output results at the output device side. 

With the aforementioned first working example, an example was explained of an Exif 
format file as a specific example of an image file GF, but the format of the image file of the present 
25 invention is not limited to this. Specifically, it is acceptable if the image file includes the image data 
that is to be output by the output device and the output control information CI that specifies image 
data output conditions (image quality adjustment parameters) for the output device. This is because 
with this kind of file, it is possible to reduce the differences in output images between the image data 
generated at the image file generating device (image display obtained via a monitor, etc.) and the 
30 output image at the output device. Also, simply by sending the image file to the output device side, it 
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is possible to apply any characteristics for output images at the output device. 

Also, included in image files GF that include image data and output device 
control information CI are files that can generate relational data related to output 
device control information CI, can store image data and output device control 
information CI in independent files, and reference relational data when doing image 
processing and correlate image data and output device control information CL In this 
case, though image data and output device control information CI are stored in 
separate files, at the point that image processing is done using the output device control 
information CI, image data and output device control information CI are in a 
relationship for which they can not be united, and this is because this is functioning 
essentially in the same way as when they are stored in the scene file. Specifically, at 
least at the point of image processing, the embodiment used with image data and 
output device control information CI correlated is included in the image file of this 
working example. 

The DSC 22 and printer 24 used for the aforementioned second and third 
working examples are nothing more than examples, and the structures of these 
examples are not limited by the noted contents of each working example. For DSC 22, 
it is acceptable as long as there is at least a function that can generate an image file GF 
of the first working example. Also for printer 24, it is acceptable as long as the output 
control information CI of the image file GF of the first working example is analyzed 
and an image is output (printed) according to the specified image output conditions. 

Image files GF that contain image data and output device control information 
CI include files created by generating association data associated with the output 
device control information CI, storing the image data and output device control 
information CI in separate files so as to enable the image data and output device 
control information CI to be associated by referring to the association data during 
image processing. While in this case image data and output device control information 
CI are stored in separate files, during image processing using the output device control 
information CI, the image data and output device control information CI are indivisibly 
united, so functioning is substantially the same as with storage in a single file. 
Associated image data and output device control information CI are at least during 
image processing, is included in image file GF in the present embodiment. Motion 
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video files stored on optical media such as CD-ROM, CD-R, DVD-ROM and DVD- 
RAM are also included. 

In the preceding embodiments, a digital still camera is used to generate image 
files, but a digital video camera could be used as well. Files generated by digital video 
5 cameras take the form of image files containing static image data and output control 
information, or motion video files containing motion video data (e.g. in MPEG format) 
and output control information. Where motion video files are used, some or all of the 
frames of the video are subjected to output control with reference to the output control 
information. 

% 10 Obviously, numerous modifications and variations of the present invention are 

possible in light of the above teachings. For example features described for certain 
hi embodiments may be combined with other embodiments described herein. It is 

F " therefore to be understood that within the scope of the appended claims, the invention 

O may be practiced otherwise than as specifically described herein, 

r ij 15 This document is based on, and claims priority to, the following four Japanese 

jjf Applications, the entire contents of each of which being incorporated herein by 

P reference: Japanese application No. 2000-265794, filed September 1, 2000; Japanese 

application No. 2001-34518, filed February 9, 2001; Japanese application No. 2001- 
74696, filed March 15, 2001; and Japanese application No. 2001-217878, filed July 18, 
20 2001. 
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